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THE VARIETY OF REDUCTIONS FOR A REDUCTIVE SYMMETRIC PAIR 

MICHAEL LE BARBffiR GRUNEWALD 

o' 

fv^ ■ Abstract. We define and study the variety of reductions for a reductive sym- 

metric pair {G,0), which is the natural compactification of the set of the Cartan 
t^y' subspaces of the symmetric pair. These varieties generahze the varieties of re- 

ductions for the Severi varieties studied by Iliev and Manivel, which are Fano 
varieties. 

We develop a theoretical basis to the study these varieties of reductions, and 
1/^ ' relate the geometry of these variety to some problems in representation theory. 

A very useful result is the rigidity of semi-simple elements in deformations of 
. . algebraic subalgebras of Lie algebras. 

^^ ' We apply this theory to the study of other varieties of reductions in a com- 

.^^ I panion paper, which yields two new Fano varieties. 

1. Introduction 

The problem of classifying all complex analytic compactifications of C" which 

have second Betti number &2 = 1/ also known as irreducible compactifications, was 

^ I stated by Hirzebruch [IJ. An irreducible compactification is always a Fano vari- 

2^ ■ ety, and classifiying the former ones is, surprisingly, not easier than classifying 

l>!!i_ I the later ones. Indeed, the classifications of the irreducible compactifications of 

f~^ ■ dimension 1, 2 and 3 came as specializations of the classifications of the Fano 

varieties of the corresponding dimension. For the dimension 4 or above, there is 
f^ ■ at the current time no classification of the irreducible compactifications available 

f^ I and no classification of the Fano varieties. The irreducible compactifications of 

the affine spaces of dimension less than 3 are the projective spaces P^, P^ and P'^, 
the quadric Q^, and two Fano varieties which have b^, = and respective Fano 
index 1 and 2. See Miiller-Stach [2J for a short description of these varieties and 
an account on other results about compactifications of affine spaces, 
j^ ■ As pointed out in [IJ, the fundamental homogenous spaces of reductive groups 

are examples of compactifications of the affine space, but new examples are very 
hard to find and seem to always show up as finite families. This lack of examples 
hinders the efforts aimed at the classification of Fano varieties or even that of 
irreducible compactifications of affine spaces. In this paper w^e associate to any 
reductive symmetric pair {G,6), where G is a reductive complex group and 6 an 
involution of G, its variety of reductions 9^. Some of these varieties were previously 
obtained by different means, and studied by Ranestad and Schreyer 1 3 1 and Iliev 
and Manivel [4J. At the present time, the study of seven of these varieties of 
reductions IH has been carried out, revealing that all of them are normal Fano va- 
rieties, and the smooth ones are even compactifications of the affine space which 
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2 MICHAEL LE BARBIER GRUNEWALD 

have 1)2 ~ ^- This observation is our main motivation for defining the varieties of 
reductions: the study of many of the low-dimensional ones may be carried out, 
and yield other compactifications of affine spaces or Fano varieties. 

We study here general properties of varieties of reductions for symmetric pairs, 
and use this theory in a companion paper ||5l to study three more examples of 
variety of reductions (two of them count in the number seven mentioned above). 
While we were primarily interested in developping tools and methods suited to 
the practical study of examples, it turned out that the general theory presents 
interesting aspects in its own right and relates to other problems in the represen- 
tation theory of complex Lie groups. We now define the varieties of reductions 
and then outline the results of our study. 

1.1. Variety of reductions for a symmetric pair. A reductive symmetric pair (G, 6) 
has a reductive group G as its first member and an involution of G as its second 
member. These pairs occur in the study of real forms of complex reductive groups 
and symmetric spaces, and they were classified using many different invariants, 
see S. Araki [6], A. G. Helminck [7], and T. Springer [8], for instance. To such a 
pair we attach its connected fixed point group K = (G^)°, which is reductive, and 
the decomposition of the Lie algebra g of G as eigenspaces for the involution 6' 
tangent to 9 at the unit element of G: 

= 0(0')i ©0(^0-1 = «®p- 

This decomposition is called the Cartan decomposition of g, and p the anisotropic 
space of the symmetric pair. We will use [9J by Kostant and Rallis and [10 J by Tau- 
vel and Yu as references for results about the operation of X in the anisotropic 
space p. 

1.2. Definition. A Cartan subspace of p is a linear subspace a of g that is contained 
in p and in some Cartan subalgebra of g, and that is maximal in the family of such 
subspaces ordered by the inclusion. 

Any two Cartan subspaces of p are X-conjugated 1^, Theorem 1]. Their com- 
mon dimension r is the rank of the symmetric pair (G, 0) and their set D\o is 
a K-orbit in the Grassmann variety Q{r,p) of r-planes in p. 

1.3. Definition. The variety of reductions D\ for the symmetric pair {G,6) is the 
closure in G{r,p) of the set D\o of all Cartan subspace of p. 

It is customary, while sometimes ambiguous, to write {G,K) for {G,9) when 
referring to a particular symmetric pair. We stick to this usage, and emphasize 
that the Cartesian square x © of a reductive group © is turned into a symmet- 
ric pair by the involution swapping its two factors. Ranestad and Schreyer |3l 
have shown that the variety of reductions for the symmetric pairs (SL„, SO,,) are 
smooth only for n < 5. Iliev and Manivel |4| studied the varieties of reductions for 
the symmetric pairs (SL3,S03), (SL3 x SL3, SL3), (SLg, Spg) and {£(,,¥4). These 
four symmetric pairs occur as structure symmetries for the four simple Jordan 
algebras of rank 3 HJ. In (5) we study the varieties of reductions for (SL4, SO4), 
and for the Cartesian squares of Sp4 and G2. 

1.4. Abelian subalgebras. In the small rank cases f4j[TTl|5l the variety 21 of all 
r-dimensional subalgebras of g contained in p is not larger than ?l, but we show 
the 
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Theorem (|5.3[ 19.71 . Every point in 5H fs the Lie algebra of a subgroup of G. If G has 
large enough rank, then 21 contains a point that is not the Lie algebra of a subgroup of G. 

In general 9^ is a strict irreducible component of 21. We also show that 2t 
consists of infinitely many orbits, while there is still no evidence that the same 
can happen for $H. 

Abelian subalgebras of g have been extensively studied, by Schur, Malcev, Pa- 
nyushev and others, but very little is known about the geometry of 21. An enu- 
meration of its irreducible components is not even at hand. Further investigations 
may confirm that the study of $H is easier than the one of 21 is. 



1.5. Rigidity of anisotropic subtori. One of our main result l|4.6|l states that, if ao 
is the degeneration of the conjugates of a subalgebra ai of g contained in p under 
the operation of K, then the semi-simple elements of ao are rigid. This means that 
they are the limits of the semi-simple elements in the conjugates of Oi . This rigid- 
ity theorem enables us to study varieties of reductions through their subvarieties 
of reductions (see below), but also to contribute to the theory of decomposition 
classes. Decomposition classes for a reductive symmetric pair generalize Jordan 
types for GL„. They were introduced by Bohro and Kraft fT2l to study sheets in 
Lie algebras. As an application of our rigidity theorem, we show the 

Proposition l|B.l|l . The closure of a decomposition class is a union of decomposition 
classes. 

1.6. Orbit theory for the varieties of reductions. While the theory is still in- 
complete, there is some open subset of 5H whose orbits we understand well, by 
comparing them to decomposition classes in g. 

Sending a point x G g to its centralizer, we define a rational map C from g to 5H. 

Proposition 1 13.71 13.151 13.161 1. The map C enjoys the following properties: 

(1) Its pointwise image is an open subset Dly of the smooth locus ofD\. 

(2) The pre-image of an orbit Oq in D\r is a decomposition class Vq in g. 

(3) If Vi is a decomposition class in g containing Vq in its closure, then C is defined 
at any point of Vi and the image of T>i is an orbit containing Oq in its closure. 

The problem of describing the genericity relations between decomposition 
classes is much easier than the analogous problem for orbits. 

The previous proposition describes a bunch of orbits of low-codimension in D\, 
but two important questions remain: What is the codimension of the comple- 
ment of the image of C? How intricated are the combinatorics of the orbits in 
this complement? The variety of reductions for (SL4, SO4) is smooth, while the 
centralizer map is not surjective. In the varieties of reductions for the Cartesian 
squares of Sp4 and G2, the image of the centralizer map equals the smooth locus, 
and its complement has codimension 2. 

While we are not yet able to answ^er these questions, we noticed an interesting 
structure in the family of varieties of reductions, described in terms of subvarieties 
of reductions. 

Let a be a Cartan subalgebra of g, a' a subalgebra of o and G' its centralizer. 
Let *H' denote the closure of G'a in *H. As the data (o, a') runs through all its 
possible values, £H' describes the set of subvarieties of reductions of IH. Note 
that if G' is smaller than G, the variety ^V is isomorphic to the variety of Cartan 
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reductions for the derived group of G', which has smaller rank than G. We can 
now state our 



Theorem ( 16.41 and its corollaries). Let xq be a point o/*H. Then: 

(1) Xq is contained in a strict subvariety of reductions ofD\ if, and only if, it contains 
a non-nilpotent element of g. 

(2) A point x\ is more general than xq in 9^ if, and only if, any subvariety of re- 
ductions *K' containing xq also contains a G-conjugate ofx-[ that is more general 
than Xq in D\'. 

Hence, if we are able to describe orbits in all the subvarieties of reductions 
of *H, and there is only a finite number of isomorphism classes of them, we can 
as well describe orbits in the open subset of $H whose complement is 

fH,i = { u e 9^ I every m G u is nilpotent } . 

Proposition jS.Si . The subvariety D\„ ofDl contains the closed orbits ofDl. 

We may learn soon how to enumerate the closed orbits of *H, but the de- 
tailed orbit theory of ?l„ remains very mysterious. In particular we do not know 
whether it can contain infinitely many K-orbits or not. 

1.7. Partial positivity of the anticanonical class. The minimal rational curves 
in D\ are the lines of the natural projective embedding of 91 that are contained 
in 91. We can describe the generic ones in terms of the roots of the operation of a 
on g. This description is precise enough to let us study the deformations of such 
a line, find explicit free curves contained in the smooth locus of 9\ and compute 
the intersection of the anticanonical class on these lines: 

Corollary (|8.101 l. Let a & Dlgbea general point of ^i and A a line through a contained 
in *H. Let m be the dimension of the maximal linear subspace ofD\ through a containing A. 
If A is contained in the smooth locus ofy\, then 

-Kr ■ A = m + 1 

where K,- is the canonical class of the smooth locus ofDl. 

This intersection number is always positive, it equals 3 when 9^ is a variety 
of Cartan reductions. When 91 has Picard number one and its canonical class is a 
Cartier divisor, this yields the Fano index of 91. 

The open orbit in 9^ is affine since the stabilizer of a point therein is reductive, 
its complement is therefore a union of divisors. In the examples we studied |5|, 
the complement of the image 9lo of C has codimension at least 2 — the codimen- 
sion 2 occuring for the variety of Cartan reductions for G2. This means that the 
image of the centralizer map carries enough information to describe the Picard 
group of 91. In the general theory, it is possible to bound by above the dimension 
of the orbit of a point outside of 9lo, but narrowing our attention to 9lo we would 
miss a divisor in 91 \ 9lo swept out by a continuous family of small dimensional 
orbits, if such a divisor exists. Hence the flaws in our orbit theory of 91 obstructs 
our understanding of the Picard group of 91. 
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2. Variety of reductions for a symmetric pair 

2.1. Variety of reductions. Let {G,6) be a reductive symmetric pair with rank r 
and Gir,p) the Grassmann variety of r-planes in p. 

2.2. Definition. We call the set $Ho of Cartan subspaces of p the set of ordinary 
reductions for the symmetric pair {G,6). Its closure $H in G{r,p) is the variety of 
reductions for (G, 6), and 5Hs = 5H \ *Ho is the set of special reductions. 

The variety of reductions depends only of the isogeny class of G, not of its 
fundamental group. 

Recall that Grassmann varieties are embedded in projective spaces of some 
exterior powers, in particular a reduction a 6 9^ of which a 6 a' is a basis has 
image [fli A ■ ■ ■ A a,-] e P(A'p). 

2.3. Variety of anisotropic subalgebras. The variety $H of reductions for a reduc- 
tive symmetric pair is a subvariety of the variety 21 of all anisotropic subalgebras 
of g of dimension r. 

Let Ay : A' p — )■ I ® A'^^^p be the linear map whose value on the decompos- 
able r-multivector xj A • • • A x,- is 

Ar{xi A ■ ■ ■ AXr) = Y2 [Xj, Xj] (gi Xi A ■ ■ ■ A Xj A ■ ■ ■ A Xj A ■ ■ ■ A Xr 

where terms with a hat above shall be discarded. The kernel Ker A^ of Ar is a 
linear subspace of P(A'^p) meeting ^(r, p) along the set of subalgebras of g of 
dimension r contained in p. 

2.4. Definition. The variety of anistropic subalgebras for the reductive symmet- 
ric pair {G,6) is the section 2t of G{r,p) with Ker A^ in P(A''p). 

When the symmetric pair associated to a reductive group is under considera- 
tion, we call 21 the variety of abelian subalgebras for the given group. We illustrate 
the presumable complexity of 2t in section lO. 

2.5. Roots relative to an ordinary reduction. Let a be an ordinary reduction and 
let <I> be the set of w^eights of a in g. The decomposition of g into weight spaces 
relative to o is 

(2.1) = cg(a)©0g(o)<, 



6 MICHAEL LE BARBIER GRUNEWALD 

where Cg(a) is the centralizer of o in g and ^(a)^ the weight space for the char- 
acter a of a. The following propositions enable us to work with the decomposi- 
tion linil, for a proof, see Tauvel and Yu |10, 37.5.3, 36.2.1, 38.2.7, 38.7.2]. 

2.6. Proposition. The centralizer of a in q is the direct sum of a and the centralizer of a 
in t 

2.7. Proposition. The set <3> is a root system. 

We emphasize that this root system may not be reduced, how^ever the root 
system relative to the symmetric pair of a reductive group is the root system of 
the reductive group itself, and is thus always reduced. 

Since 6' swaps Q{a)n and Q[a)-n, the Cartan decomposition and the weight 
spaces decomposition are not comparable. It is thus useful to introduce the sub- 
spaces 

(2.2) p(a)«; = (g(a)<i©0(a)_„)np and «(«)«: = (0(a)« ©0(a)-«) n«. 

These subspaces satisfy the relations p{a)oi = p(a)-fl;, J(a)a = t{a)~cc, and p(o)a ® 
t{a)ci = fl(o)a ® fl(ci)-fl;. We can then decompose t and p in the following manner: 

(2.3) « = m® «(a)^ 

ae<3>+ 

where m = C{(a) is the reductive Lie algebra centralizing a in t; 

(2.4) p = a© p(a)^. 

The spaces t(a)a and p(a)ff are not stable under a but are sw^apped by it: we 
have ad(a)t(a)a = p{a)a and ad(a)p(a)fl; = {(a)^. This allows us to compute the 
dimension of d\: 

2.8. Proposition. The dimension ofD\ is dimp — r. 

3. Regular orbits and the incidence diagram 

3.1. Incidence variety. Let J be the incidence variety associated to 5H: 

J' = {(u,M)e9=^Xp| MGU}. 

The projections of ^7 to p and D\ are respectively denoted by n and t. Notice that, 
since the tautological fibre bundle on Q{r,p) is locally trivial, the morphism t is 
open. 

3.2. Centralizer map. An element m e p is regular when the dimension of its cen- 
tralizer C(m) in p is minimal. It is then an r-dimensional subalgebra of g and the 
map C is a well-defined morphism from TZ to 21. We call regular a reduction 
m9\r = C{TZ), or a X-orbit through a regular reduction. 

We write S for the set of semi-simple elements in p, and Af for the set of 
nilpotent ones. The set TZo = TZCiS oi ordinary elements in p that are both regular 
and semi-simple is an open subset of 7?,, dense in p. The set of r-dimensional 
subspaces of p containing an ordinary element is an open subspace of Q{r,p). 
This implies the following 

3.3. Proposition. The variety $R of reductions for a reductive symmetric pair is an 
irreducible component of the variety 21 of anisotropic subalgebras for this pair. 
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3.4. Corollary. The centmlizer of any regular element is a reduction, that is, C maps TZ 

torn. 

3.5. Incidence diagram. The incidence variety and the centralizer map fit to- 
gether in the incidence diagram: 

J 

P(p) — > «K 

and the centralizer map C equals t o ti^^ above TL. We use these constructions to 
explore the variety of reductions. 

3.6. Regular orbits are contained in the smooth locus. The centralizer map 
parametrizes an open and smooth subset of *H: 

3.7. Theorem. The set 9^,- = C(JVj of regular reductions is an open subset ofD\, con- 
tained in the smooth locus. 

Proof. The subset of Q{r,\)) of subspaces meeting 7?, is open, which implies the 
truth of the first statement. We now study the smoothness. 

Let mq G ^/ we study the tangent space to 21 at u = C{uq). We choose a 
supplementary subspace D to u in p and identify the affine neighbourhood of u in 
the Grassmann variety G{r,p) consisting of points admitting o for supplementary 
with the space A = £(u, d) of linear maps from u to u. A point a E A belongs 
to 21 if, and only if for all (mj, M2) G u^ 

[mi +a{ui),U2+a{u2)] = 0; 

the linear equations of Tu2l are therefore 

(3.1) [ui,a{u2)] = [U2,a{ui)] 

for all (mi, M2) G u^- We narrow our attention to the subset of the linear equations 
of Tu2l obtained by letting M2 = "o- Note that u is precisely the kernel of the re- 
striction of ad(Mo) to p, hence, once uj is given there is at most one value of a{ui) 
satisfying ( 13. It . The tangent space is thus parametrised by a subspace of the set of 
images a{u(j), when a varies in A and Tu2l C 0. But dimTu2l > dimu2l > dim 9^ 
and dim<K = dimu ^M- We conclude that dimTu2l = dimu2l = dim 9^. The 
regular reductions are thus contained in the smooth locus of 91. D 

3.8. Review of decomposition classes. The centralizer map puts the K-orbits in 
its image in correspondence with decomposition classes in 91. Decomposition 
classes generalize the familiar Jordan types in sl„ to every symmetric pairs. They 
are discussed by Bohro and Kraft [12J, Broer [13] and Tauvel and Yu [lOJ. We 
briefly review elements of this discussion, referring to |10| for further details. 

3.9. Definition. Let u and v be two elements in p with respective Chevalley- 
Jordan decomposition u = Ug + u„ and v = Vs + Vn- They have the same decompo- 
sition class when there exists g & K such that ^ • Cp (ms) = Cp (^s) arid gu„ = v„. 

This defines an equivalence relation on p. We write T> for the associated par- 
tition and T>{u) for the element of T> containing u. Notice that decomposition 
classes are punctured cones in p, so that their projectivizations define a partition 
of the projective space P(p). 
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This relation is equivalently described with double centralizers. The double cen- 
tralizer of m G p is 

Cp (m) = { i; e p I Viv e Cp (m) [v,iu]=0}. 

This is the set of elements in p whose centralizer in p contains Cp(M). Chevalley's 
theorem implies that 

(3.2) cl{u)o = {vep\ cp{v) = cp{u)} 

is a dense open subset of Cp(M). 

3.10. Proposition ((TO", 38.8.3, 39.5.1 and 39.5.4]). For two elements in p, the follow- 
ing statements are equivalent. 

(1) They have the same decomposition class. 

(2) Their centralizers in p are K-conjugate. 

(3) Their double centralizers in p are K-conjugate. 

3.11. Corollary ([TO', 39.5.5]). The decomposition class T){u) ofu&p is K ■ Cp{u)o. 
This is an irreducible locally closed subvariety of p. 

3.12. Proposition (|10, 39.5.6]). The set T> of decomposition classes in p is finite. 

Thus, decomposition classes form a finite partition of p into locally closed sets. 
It follows that any irreducible subvariety X of p or P(p) is the closure of X n X'x 
in X, for a unique decomposition class T>x G T). We say Vx is the dominant 
decomposition class in X. 

If u is regular, semi-simple or nilpotent, elements of T>{u) are regular, semi- 
simple or nilpotent, and we call 'D{u) a regular, semi-simple or nilpotent decom- 
position class. 

In lB.ll w^e use our rigidity theorem 14.61 to prove that the closure of a decompo- 
sition class is a union of decomposition classes. 

3.13. Genericity relation for regular orbits. We want to describe the genericity 
relation for orbits in D\, that is, which orbits lie in the closure of which. An 
orbit Oi is more general than an orbit Cg when Og lies in the closure of O^; 
similarly, a decomposition class T>i is more general than a decomposition class Pg 
when Vq is contained in the closure of Vi . 

Through the centralizer map, the genericity relation for regular orbits reduces 
to the genericity relation for decomposition classes. 

3.14. Proposition. The image of a regular decomposition class through the centralizer 
map is a regular K-orbit of D\. 

This is a reformulation of the equivalence between (1) and (2) in | |3.10| |. We are 
then allowed to speak of the decomposition class associated with a regular orbit: 
it is its inverse image through the centralizer map. 

3.15. Proposition. Let 5Hj and JHh be orbits in $H. If D\i is more general than 9^n 
and Dili is regular, then 9lj is regular and its decomposition class is more general than the 
one of Dili. 

Proof. Let pi be the projection T(7r~^(5^i)) of 9^i through the incidence diagram 
of D\ | |3.1| |, and pn the projection of 9^n- Note that $Hn being regular, pn is a 
decomposition class and is thus irreducible | |3.11| l. 
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The morphism n is continuous, so that 7r^^(*Hj) contains 7T^^(9^n) ^ its clo- 
sure; the morphism t is open, so that pi = t(ji (^\)) contains pn in its closure. 
Let q be an irreducible component in pi degenerating onto pn. The decomposition 
class I?q dominant in q is more general than pn, it is thus regular and *Hi is the 
regular K-orbit C(q) in *H. D 

3.16. Corollary. Two regular orbits compare in the same way than their corresponding 
regular decomposition classes do. 

Proof. One implication is the previous proposition, the converse follows from the 
equivalence of (1) and (2) l|3.10l l and the continuity of the centralizer map C. D 

To put it another way, the centralizer map C induces an increasing isomor- 
phism between the ordered set of regular decomposition classes in p and the 
ordered set of regular orbits in the variety of reductions for a symmetric pair. 

3.17. Irregular locus. The irregular locus W is the complement p \ 7^ of the set 
of regular elements. It was proven by Veldkamp |14| for the symmetric pair 
associated to the Cartesian square of a group that the irregular locus W is the 
set of points where the reductive quotient ^ : p — )• p // X fails to be submersive. 
However it remains unknown wether these equations span the ideal of W or 
not. We noticed that these equations are geometrically realized by the centralizer 
map 1 13.181 below). This could be helpful to determine if the ideal they span is 
reduced or not, or if the caracterization of the irregular locus given by Veldkamp 
extends to the symmetric setting. 

We define the Jacobian morphism Jcp associated to the reductive quotient (p : 
p -> p // K by 

}<p : p X A'p -> C 

It is a homogeneous morphism, thus }(p E S^p* A'^p* for some N. The restric- 
tion to p of a non degenerate bilinear form on g that is invariant under G and 6 is 
definite and X-invariant. Hence we can see J(p as a K-invariant rational map 

J,^ : P(p) -> P(A^p) 

by identifying p with its dual. 

3.18. Proposition. The Jacobian morphism Jcp coincides with the centralizer map C. 

Proof. Let o be a Cartan subspace of p, fl G a'^ a basis of a and x a regular element 
of a. We write g' the centralizer of a in g and {' = g' fl i, p' = g' n p', so that adx 
is a linear automorphism of g' exchanging i' and p'. 

Now let ^ = ^i A • • • A ^,- be a decomposed r-vector divisible by a vector ^i 
belonging to p'. If / is a X-rnvariant function and e — > 0, w^e have 



/(exp(e(adx)-i^i)x) =/(x) =/(x) -eT,/(^i 



■0 e . 



Hence Txf{^i) = and J(p{x, ^) = when ^ is divisible by an element of p'. Now 
the reductive quotient is submersive at the regular element x [9_, Theorem 13] so 
that J(p{x, a-i A ■ ■ ■ A ar) 7^ 0. This shows that J(p and C agree on 71. D 
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4. Rigidity of anisotropic tori 

4.1. Review of stability. Concepts familiar to the geometric invariant theory 
show up in the study of degeneracies of semi-simple elements. Let us recall 
the appropriate definitions and facts. 

4.2. Definition. Let K be a reductive group, V a finite dimensional representa- 
tion of y and X C P{V) a quasi-projective variety stable under the operation 
of K. A point [v] of X is called 

• semi-stable if there exists a K-invariant non-constant homogeneous poly- 
nomial that does not vanish at v; 

• poly-stable if it is semi-stable and the K-orbit of [v] is closed in the set of 
semi-stable elements of X; 

• stable if it is poly-stable and has finite stabilizer in K; 

• unstable if it is not semi-stable. 

When X is closed subvariety of P{V), its semi-stable, poly-stable, stable or 
unstable points are the points of P{V) of the same kind, belonging to X. We say a 
non-zero vector Z7 G V is semi-stable, poly-stable, stable or unstable, according to 
the nature of [v] . The following proposition is a basic result in geometric invariant 
theory: 

4.3. Proposition. Let Xbea closed subvariety ofF{V) stable under the operation ofK. 
Then: 

(1) The point [v] is semi-stable if, and only if, does not belong to the closure of 
the K-orbit of v in V . 

(2) The point \v\ is poly-stable if, and only if, the K-orbit ofv is closed in V. 

According to f9l these propositions can be rephrased the following way in the 
setting of reductive symmetric pairs: 

• the set of unstable elements in p is precisely the set J\f of nilpotent ele- 
ments, with removed; 

• the set of poly-stable elements is the set S of semi-simple elements, with 
removed; 

• the set of semi-stable but not poly-stable elements is precisely the set of 
elements with non-zero semi-simple part and non-zero nilpotent part; 

• the set of stable elements is not empty if, and only if, the rank of the 
symmetric pair (G, 0) equals the rank of reductive group G; in this case 
the set of stable elements is the set of anisotropic semi-simple elements 
whose centralizer in p is a Cartan subspace of g. 

The foUo^ving property of anisotropic algebras is remarkable with respect to 
stability theory: for any anisotropic algebra a, the set S{a) of poly-stable elements 
of a (with zero added), and the set M{o,) of unstable elements of a {idem) are vector 
subspaces of a. 

AA. Degeneracies of anisotropic algebras. We introduce a language suited to 
our study of degeneracies. Let K be a group acting on a complete variety X. We 
consider a point Xi G X and a degeneration xq of xi, that is, a point belonging to 
the closure in X of the orbit Kx^. There exists an irreducible smooth curve C in K 
such that Xq belongs to the closure of C°xi, and we only consider degenerations 
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along such curves. In the study of the degeneration along the curve C°, it is 
convenient to introduce the points at infinity of C. 

Let C be the smooth completion of C . The points in C \ C are called points 
at infinity Since X is complete, the rational map sending c G C to cxi extends to 
a regular map on C and, by a slight abuse of notation, we write cxj for the image 
of c under this map even for c lying in C\C^. Now let cq be a point at infinity 
whose image is xq. We say that C" is an arc in K pushing x\ toward xq, and Cq is a 
point at infinity taking x\ to xq. 

The way semi-simple elements of an anisotropic algebra behave when it is 
deformed by the operation of K is described by the following theorem. It has 
many interesting consequences, such as 14. 6[ WM and [BA] 

4.5. Theorem. Let a\ be an l-dimensional anisotropic subalgebra and uq e GiLp) lying 
in the closure of the K-orbit through ai. Let C° be an arc in K pushing ai toward oq 
and cq a point at infinity taking oi to ao- 

Then, unless ag only contains nilpotent elements, there exists a semi-stable element sq 
in ao and a semi-stable element si in a\ pushed toward sq by C° and brought to Sq by cq. 

Moreover, if oi fs closed under the Chevalley-Jordan decomposition, then oq ;s closed 
under the Chevalley-Jordan decomposition as well, and for each semi-simple element sq 
in ao there exists a semi-simple element si in ai that is brought to sq by cq. 

Proof. We denote by Rq the local ring of C° at cq, mo its maximal ideal and e a 
local parameter of C° at cq. According to I IA.SI I there exists a basis x of ai, a basis y 
of ao, a r-uple n of integers and a r-uple rj G (mo ®py such that for all k 

cxjt = e"^!/)c + '?fc)■ 
If all of the i/(f are nilpotent, then ao purely consists of nilpotent elements. Hence, 
we assume that for some integer k the vector i/j. is semi-stable and let / be a K- 
rnvariant function, homogeneous of degree N > 0, that does not vanish at y]^. We 
compute 

/(x,) = e~"V(y, + ;?,). 

and show that n^t = 0. On the one hand, the function f{x}:)/f{yk + ^k) is regular 
at Cq, which implies Mj- > 0. On the other hand, the non zero function /(xj.)e^^"'f 
is regular at cq, which implies mj^ ^ 0- Thus nj^ equals zero and / does not vanish 
at xj-. We conclude that cx^ converges to y^ when c approaches cq and x^ is 
semi-stable. 

We now proceed to the proof of the second part of the statement and assume 
that ai is closed under the Chevalley-Jordan decomposition. According to | |A.9l l 
w^e may assume that each of the Xj. is either semi-simple or nilpotent. We show 
that each of the y^ is either semi-simple or nilpotent. 

The image of A/" in P(p) is closed, hence xj- G A/ implies y^ G A/. We now 
assume that Xj. is semi-simple. If y^ is not nilpotent, then n;;- = as before and 
we have xj- = yk + Vk- Hence cxj- converges toward i/j- as c approaches cq. But xj. 
is semi-simple and its orbit is closed, so i/j- is semi-simple and conjugated to Xj.. 
Thus each i/j^ is either semi-simple or nilpotent, which implies that the anisotropic 
subalgebra oo of dimension / spanned by the y^ is closed under the Chevalley- 
Jordan decomposition. 
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Last, if So e oo is semi-simple, it is a linear combination sq = T.i^^Ks '^oVk of the 
semi-simple yj-'s, whose set of indice is Xg c { 1, . . . , / }. Hence the translates csi 
of sj = Ejcgk, "^0 -"^i: converge toward sq as c approaches cq. D 

If a /-dimensional anisotropic subalgebra oi of g degenerates on oq, the semi- 
simple elements subsisting in oq can be rigidified, that is, there exists an equivalent 
degeneration leaving these semi-simple elements untouched: 

4.6. Corollary (Rigidity of anisotropic tori). Let a^ be a l-dimensional anisotropic 
subalgebra closed under Chevalley-Jordan decomposition, % e QiLp) ^ying in the closure 
of the K-orbit through oi and C be an arc in K pushing o^ toward qq and cg a point at 
infinity taking aj to oq. Let S{a()) be the linear subspace o/qq spanned by its semi-simple 
elements. Then there exists a K-conjugate a[ of oi containing 5(oo) and a degeneracy 
curve in the centralizer Cj<;(5(ao)) 0/^(00) in K pushing a[ toward uq. 

This corollary is a consequence of 14. 51 and the following general lemma dealing 
with degeneracies of orbits: 

4.7. Lemma (Straightening of degeneracies). Let Kbea connected group and X and Y 
be two K-varieties. Let x\ be a point in X and xq a point belonging to the closure of the K- 
orbit through x\, and let y\ a point in Y. Let C be a degeneracy curve in K pushing x\ 
toward xq and cq a point at infinity taking x\ to xq. If cg takes y\ to a conjugate 1/0 = hy\, 
then there exists a degeneracy curve in the identity component of the stabilizer ofy^ in K 
pushing hxi to xq, and a point at infinity taking hxi to xq. 

Proof. The rational map sending c to cyi is regular at cq and cqi/i is a conju- 
gate 1/0 = ^3/1 of yi- Let C(co) = C° U { Co } and define 

Z = { (g,c) e X X C(co) I gcyi = yo } • 

The map cy\ is regular at cq, and its value belongs to the orbit of yi, thus (1, cq) G 
Z belongs to the closure of the inverse image W of C° under the projection of Z 
to C(co). Let D be a degeneracy curve in W containing (l,co) in its closure. Then 
the image (C")' of W under the map sending (g, c) G Z to gch^^ G X is contained 
in the centralizer of yo G X and pushes hxi toward xo. This map extends to 
a regular map at (l,Co) whose image is a point at infinity for (C)' taking hx\ 

to Xo- n 

5. Algebraicity of reductions 

5.1. Degeneracies of subgroups. The fact that each point in the variety of reduc- 
tions is the Lie algebra of an algebraic subgroup of G is a consequence of the 
following general observation: 

5.2. Proposition. Let G be an algebraic group and H c G x B an irreducible family of 
subvarieties ofG over a basis B. If the generic member ofH is a subgroup ofG, then each 
member of H is a subgroup of G. 

Proof. The algebraic subgroups of G are precisely the subvarieties H of G such 
that the restriction of the morphism ip : G x G — )• G defined by ^{gi,g2) = S1S2 
maps H X H in H. Let 

B" = {b eB\ Kb is a subgroup of G } 
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and T-L" the restriction of T-i to B° , and assume that B° is dense in B. Since "H 
is irreducible, "H" is dense therein. Hence xp^^{'H) contains 71 x Ti, the closure 

of n° X n". D 

5.3. Corollary. Any point of the variety of reductions is the Lie algebra of an algebraic 
subgroup of G. 

Proof. Let oq be a point of 9\, oi a Cartan subspace of p and C° a degeneracy 
curve in K pushing ai toward oq. We denote by Ai be the connected subgroup 
of G whose Lie algebra is ai, by G a projective completion of G and by C a smooth 
completion of C°. We consider the family VcGxP(p)xC obtained by taking 
the closure of 

V° = { ig, [x],c) e G X P(p) xC° \ g ecAi and x e cai } . 

Let cq be a point of C taking ai to qq. The fiber Vcg projects on G as a set meeting G 
along a subgroup Aq of G | |5.2t , and on P(p) as the projectivization of ao- Hence 
the Lie algebra of Aq contains qq. But the family V over C is flat, since the curve C 
is smooth [15, 9.7], and the dimensions of Ai and ai agree flF. 9.5]. D 

5.4. Nilpotence of closed orbits. Degeneracies in the varieties of reductions ul- 
timately turn each semi-simple dimension into a nilpotent one, except of course 
those belonging to the center of g: 

5.5. Proposition. If G is semi-simple, then a point in a closed orbit of D\ is contained 
in the nilpotent cone JV of q. 

Proof. Let u be a reduction belonging to a closed K-orbit in 5H, and P its stabi- 
lizer in K. The Lie algebra u is algebraic ll5.31 l and abelian, it follows from the 
Chevalley-Jordan-decomposition that the set 5(u) of semi-simple elements of u 
and the set A/'(u) of nilpotent elements of u are supplementary linear subspaces 
of u. The stabilizer in K of 5(u) hence contains P. It is thus both a reductive and 
a parabolic subgroup of K, so it equals K. This yields 5(u) =0. D 

6. SUBVARIETIES OF REDUCTIONS 

6.1. Variety of reductions and derivation. To the reductive symmetric pair (G, 6) 
corresponds a symmetric pair whose group is the derived group G' of G. Since G' 
is stabilized by any automorphism of G, the involution 9 restricts to G' , turn- 
ing {G' ,6) into a semi-simple symmetric pair. 

6.2. Proposition. Let (G, 6) be a symmetric pair and G' the derived group of G. Let K' 
be the adjoint form of the identity component of the fixed points group of {G',9). Let D\ 
be the variety of reductions for {G,9) and D\' the one for {G',9). Let p' be the space of 
anisotropic vectors of (G, 9) belonging to the Lie algebra ofG', and pz those belonging to 
the Lie algebra of the center of G. Then: 

(1) The groups K and K' have the same orbits in Dl. 

(2) The maps p :m ^ m' and j :m' ^ Ul defined by 

p(u)=unp' and i{o)=viS)pz 
are inverse K' -invariant isomorphisms. 
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Proof. To establish the first claim, we replace G with its adjoint form so that G is 
the direct product of its derived group G' and its center Zq. Now G^ = (G')^ x 
Zq, and since Z^ lies in the kernel of the map G^ -^ Aut(9^), the map K -^ 
Aut(9^) factors through K'. 

To prove the second claim, it is sufficient to show that for any u G 9^, 

(6.1) u=(unp')©pz 

holds. We notice that any reduction contains pz- The infinitesimal anisotropic 
center p2 is pointwise fixed by K, thus it is is enough to remark that any ordinary 
reduction contains it, which follows from the maximality condition. Now p = 
p' © Pz and (imi holds. D 

We may narrow our study of varieties of reductions for reductive symmetric 
pairs down to semi-simple symmetric pairs. However, reductive symmetric pairs 
appear naturally as symmetric pairs associated with centralizers of anisotropic 
tori. 

6.3. Subvarieties of reductions. Let a e IHo an ordinary reduction and a C a 
a subspace of a. The centralizer 0^(5) is a 0-stable reductive subgroup of G, 
thus (Cg (a), 6) is a reductive symmetric pair whose rank equals the rank of (G, 0) . 
Since Cg(a) C g, the variety fH(o) of reductions for the reductive symmetric 
pair (Cg (fi),(?) is a natural subvariety of the variety 5H of reductions for the re- 
ductive symmetric pair {G,6). It is naturally isomorphic to the variety of reduc- 
tions {C'Q{a),9) whose group is the derived group of CG(a). 

6.4. Proposition. Let a be a subspace of an ordinary reduction and ?l(a) C IH the 
variety of reductions for the symmetric pair (Cg(o),0). Then 

m{a) = {ue <n I uD a}. 

Proof The variety of reductions ?l(a) is a priori a subset of the right hand side. 
The reciprocal inclusion follows from (|4.6| |. D 

6.5. Definition. The reductive symmetric pair centralizing a is the reductive sym- 
metric pair (CG(a), 6). The variety of reductions containing a is the variety of reduc- 
tions £H(a) of (CG(a),0). The subvarieties of reductions of EH are the subvarieties 
of the form 9^(a). We write K(a) the adjoint form of the identity component of 
the fixed points group CG(a)^. Recall that this is the group whose action on fH(a) 
we are interested in. 

Note that the space a is tangent to the center of CG(a). Hence the semi-simple 
symmetric pair associated to {CQ{a),d) (|6.2| | has smaller rank than {G,9). The 
following propositions are immediate consequences of the rigidity of a l|4.6l l. 

6.6. Proposition. Let IH(o) be a subvariety of reductions of '■Rand O an orbit ofK in fH, 
whose codimension is k. Then O fl 9\{a) is an orbit 0/0^(5) in D\{a) whose codimension 
is k. In particular O n D\{a) is a finite union of orbits ofK{a). 

6.7. Proposition. Let 91(a) be a subvariety of reductions ofDland ao a point ofy{{a). 
If O is a K-orbit in D\ containing uq in its closure, then O contains an orbit of K{a) 
in 9i(a) containing ao in its closure. 

6.8. Proposition. Let oi and ao be two reductions, and let us assume that uq is not 
contained in the nilpotent cone N of p. Then, the following statements are equivalent. 
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(1) The K-orbit in 91 containing ai fs more general than the one containing oq. 

(2) For any subvariety of reductions D\{a) containing ao, there exists a K-conjugate 
of ai in 5H(a) whose K{d)-orbit is more general than the one of aQ. 

(3) There exists a subvariety of reductions D\{a) containing oq and a K-conjugate 
o/ai in 9^(a) whose K{a)-orbit is more general than the one o/oq. 

7. Special reductions 

The set $Hs = £H \ $Ho of special reductions is the complement of an affine open 
set in a projective variety, hence it is a divisor in $H. This divisor is hard to 
describe in the general setting: we can not even count its irreducible components. 
We are however able to show that it is cut out by a smooth quadric of the ambiant 
space 0. 

7.1. Bilinear algebra and exterior algebra. A symmetric bilinear form & on a 
finite dimensional vector space E induces a symmetric bilinear form A''b on the r- 
th exterior power of E. On two decomposed r-vectors ui A ■ ■ ■ AUr and vi A 
■ ■ ■ AVr this bilinear form evaluates to the determinant of the matrix with coeffi- 
cients b{ui,Vj). When b is regular, so is A^b. 

7.2. Special reductions. The Killing form b of the reductive Lie algebra q is pre- 
served by automorphisms of g. Consequently, the characteristic spaces i and p 
of 6' are orthogonal, since they are also supplementary, the restriction of b to any 
of them is regular. The quadratic form q associated to A'b on P(A'p) defines a 
smooth quadric Q. 

7.3. Proposition. The set D\s of special reductions is the intersection of the variety of 
reductions $K with the quadric Q. 

To begin with, we state a proposition and two lemmas. 

7.4. Proposition ( IITOl 37.5.2]). The bilinear form induced by the Killing form on a 
Cartan subspace ofp is regular. 

7.5. Lemma. The bilinear form induced by the Killing form on an anisotropic subalgebra 
ofp containing a nilpotent element is degenerate. 

Proof. Let u be an anisotropic subalgebra of p containing a nilpotent element n. 
Since u is abelian, endomorphisms ad m o ad n are nilpotent for each m G u, so 
that b{u,n) = 0. Hence n lies in the kernel of the restriction of b to u. D 

7.6. Lemma. An anisotropic algebra contains a nilpotent element, unless it is an ordinary 
reduction. 

Proof of the lemma. Let u e 21 be an anisotropic subalgebra of g of dimension r and 
let a be a Cartan subspace of q containing the semi-simple parts of the elements 
of u. The Chevalley-Jordan-decomposition induces a linear map u — t- a whose 
kernel is the set of nilpotent elements in u. Since Cp (a) = a (|2.61 the image of this 
linear map has rank r only if u = a. D 

Proof of W^ It follows from the previous lemmas that the set of reductions u for 
which the restriction of the Killing form to u is degenerate is exactly the set of 
special reductions. These points are also the ones where q vanishes, so that IHg = 

$nnQ. D 
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8. Partial positivity of the anticanonical class 

8.1. Linear subspaces of Grassmann varieties. Recall that linear subspaces of 
P(A''p) contained in G{r,p) are precisely the Grassmann subvarieties of G{r,p) 
which are also projective spaces. Grassmann subvarieties of Q{r,p) are the sets 

r(o, m) = { u e t/ (r, p) I c u c tr } 

where and ir are linear subspaces of p. Its dimension is dim (u/t)) dim (ir/u), 
and it is a linear space precisely when dim (u/o) = 1 or when dim (ro/u) = 1. 

8.2. Maximal linear subspaces of varieties of reductions. Let us recall that a 
singular torus of S is a torus whose centralizer in G is not a maximal torus. We 
say an anisotropic reductive algebra is singular when its centralizer in p is not a 
Cartan subspace. Maximal singular anisotropic reductive algebras are the kernels 
of the roots of g relative to some Cartan subspace a (|2.11 . 

8.3. Proposition. Let ^ be a maximal singular anisotropic reductive algebra. The sub- 
space Y{i) = r(3, Cp(3)) of Q{r,p) is contained in 9^, it pass through all points in 9^o 
containing j. 

Proof. Let a be a Cartan subspace containing 3 and a a root of q relative to a 
whose kernel is 3. The open subset '^{o of the irreducible component 9^ of 21 meets 
at o the linear space r(3) contained in 21. This linear space is therefore contained 
infH. D 

8.4. Theorem. The linear subspaces r(3) are maximal among the linear subspaces ofDl 
passing through a general point. 

Proof. Let o G 5Ho be a general point of 5H, and Y = Y{v,w) a linear subspace of $H 
passing through o. We shall see that needs to be a maximal singular anisotropic 
reductive algebra in order to let Y be maximal. 

Assume that has codimension greater than two in a, each pair in a x has 
its members belonging to a point of Y, now F C 21, hence C Cp (a). But Cp (o) = 
a l l2.6t and T = { a } is not maximal. 

Assume now that has codimension one in o. Since T c 2t, we have C Cp (ro). 
But this centralizer is 

a®0p(a)<» 

where the sum extends over the set of positive roots a relative to a which vanish 
on D. In order to let ro be strictly bigger than a, this set of roots must not be empty. 
There also exists a root a whose kernel contains 0, and for dimension reasons = 
Kera is a maximal singular anisotropic reductive subalgebra. Thus Y C Y{v), 
but F is maximal, it equals F(ti). In case Cp(ti) = a for each codimension one 
subspace in o, the root system of p relative to a is empty and p = o: $H is a point 
and F(ti) is maximal. D 

8.5. Corollary. Through a general point a of D\ passes a finite number of maximal 
linear subspaces of Dl, meeting transversally in a. The intersection of any two of these 
subspaces is a. 

This follows from the decomposition l|2.4|l . Notice that these linear subspaces 
do not need to share a common dimension. However, we can make this picture 
more accurate in the case of the variety of Cartan reductions for a reductive group. 
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8.6. Corollary. Let 9^ be the variety ofCartan reductions for a reductive group of rank r 
and dimension 1m + r. Through a general point o/SH passes m projective planes, any two 
of them meeting transversally in this point. 

8.7. Proposition. A general line contained in D\ is contained in the smooth locus o/9^. 

Proof. We show that a general line is contained in the image of the centralizer 
map l|3.7|l . Such a line is contained in a space r(3), hence we can replace 9\ by the 
variety of reductions for the pair { Cq{^ ),6), whose group is the derived group 
of the centralizer of 3 in G (see l6.4[ |6.2| |. We are then reduced to the case of a 
reductive symmetric pair of rank one, where IH = P(p). The generic nilpotent 
element is regular ||9l Theorem 3], so that the irregular locus has codimension at 
least 2 in £H = P(p): a generic line will miss it. D 

8.8. Canonical class. 

8.9. Proposition. Let X be a smooth algebraic variety quasi homogeneous under the 
action of an algebraic group G. For any smooth rational curve C in X touching the open 
orbit ofX, the Hilbert scheme H parametrising deformations ofC in X is smooth at [C]. 

Proof. We show that the second cohomology group H^(Nc/x) of the normal 
bundle to C in X vanishes, which occurs only if the Hilbert scheme is smooth 
at [C] [16, Theorem 2.6]. 

Let : g X X — 7- TX be the morphism obtained by restricting the map tangent 
to the group action G x X — > X. (Recall that X is embedded in TX via the zero 
section.) Partial application of 6 gives a global section 63 : X — ?■ TX of the tangent 
bundle from any a E g, and at any point x in the open orbit Xg of X under G, 
the stalk {TX)x of the tangent bundle is generated by these global sections. Thus, 
the restriction of the tangent bundle of X to Co = Xq n C is globally generated 
and Nc/xic is generated by global sections of Nc/x- 

Since C and X are smooth, the normal sheaf to C in X is locally free. It splits 
as 

Nc/x = 0{ai)®---®0{ar) 

for some integer vector a E 11 , and C(l) being the tautological bundle on C ~ P^. 
If fl, is negative, the bundle C(fl/) has no global sections, and at any point c E Co, 
global sections span at most a hyperplane in N^/xlc- Therefore the the fl,'s are 
non negative and thus H^{Nc/x) =0. D 

8.10. Corollary. Let a EDlo be a general point ofiKand A a line through a contained 
in y\. Let m be the dimension of the maximal linear subspace ofD\ through a containing A. 
If A is contained in the smooth locus ofy\, then 

-Kr ■ A = m + 1 

where K,- is the canonical class of the smooth locus of D\. 

8.11. Remark. The hypothesis on A is always satisfied when this line is suffi- 
ciently general | |8.7| |. When the variety of Cartan reductions for a reductive group 
is under consideration, we have —K,- ■ A = 3, for any such line. 

Proof. According to the Riemann-Roch formula, 

x{NA/m) = ci(NA/m) +rk(NA/iH)(l -g(A)), 
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the rank rk{N^/^) is diin9^ — dim A and the genus g{A) of A ci P^ vanishes. We 
compute: 

ci(NA/cH)=ci(raU)-ci(TA) 

-ci(det™U)-ci(0(2)) 
= -Kr • A - 2. 

By | |8.9t the Hilbert scheme 'Hr^i parametrising deformations of A in *H is smooth 
at [A]. Its dimension at [A] is h^{N/^/^) and h^{N/^/^) = 0. The Riemann-Roch 
formula eventually yields 

h°{NA/yi) = --K,-A + dim<H-3. 
We compute the dimension h^{N^/^) of "H^i another way Put 



{(a,A) 



e 9^ X ?^[A] 



o e A 



The Z component (o. A) belongs to, projects to a subset of D\ containing 9\o with 
general fiber of dimension m — 1, while this same component projects to "Hr^i 
with general fiber of dimension 1. We can then compute 

dim$K + m-l = l+/z°(NA/iR) 
hence K,. ■ A = —m — 1. D 

9. Variety of anisotropic algebras 

In this section, the symmetric pair associated to the Cartesian square of a sim- 
ple group G of rank r is under consideration. 

9.1. Rough estimate of the dimension of a nilpotent orbit. We say an orbit O 
in 21 is nilpotent if it is the orbit of an abelian algebra contained in the nilpotent 
cone M oi Q. 

9.2. Proposition. The dimension of a nilpotent orbit in 21 is less than dimG — r — 2, 
unless G has type Aj. 

Proof. Let B be a Borel subgroup of G, u the Lie algebra of its unipotent radical 
and an abelian subalgebra of u with dimension r — any nilpotent orbit in 2t 
contains such a 0. We bound from below the dimension of the normalizer of 
in g by the dimension of the normalizer nu(o) of D in u, thus obtaining a bound 
from above for the dimension of the orbit through o. 

According to the Lie-Kolchin theorem, endomorphisms of u/d adjoint to el- 
ements in D share a common nilvector, so dimnu(o)/ti > 1. Assume that this 
dimension is 1, and let v be the generic element of 0, and v' the endomorphism 
of u/tJ adjoint to v. Since v is generic, Keri^' = nu(D)/o has dimension 1 and v' is 
a cyclic nilpotent endomorphism, whose Jordan normal form consists of a single 
block. The dimension of nu(o)/t) thus equals the degree of the minimal poly- 
nomial of v' . The endomorphism of u adjoint to the generic element of u has 
minimal pol5n-iomial of degree h — 1, where h is the Coxeter number of G. Since 
this minimal polynomial also vanishes at v', we have 

dimnu(o)/o < h - 1. 
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Table 1 . Number of positive roots and Coxeter numbers 
Type n/2 h h+r 



Ar 


r{r + l)/l 


r + 1 


2r 


Br 


,1 


2r 


3r-l 


Cr 


,2 


Ir 


3r-l 


Dr 


r(r-l) 


2r-2 


3r-3 


Ee 


36 


12 


17 


E? 


63 


12 


18 


Es 


120 


30 


37 


Fi 


24 


12 


15 


G2 


6 


6 


7 



Let n/2 = dimu be the number of positive roots of G, the former inequality 
gives n/2 < h + r — 1 and from the table [l] (see Bourbaki [17]) we infer this 
inequality is only possible when G has type Ai, A2, A3, B2 or G2. Type Aj is not 
to be considered, types A2 and A3 have their variety of Cartan reductions studied 
by Iliev and Manivel mUll, and the remaining ones are studied in IS). D 

9.3. Infinitely many orbits. Iliev and Manivel fTTl established that 21 consists 
of infinitely many orbits, using the Grassmann variety associated with maximal 
nilpotent abelian subalgebras in qI„ for n > 6. Malcev lUHl classified abelian 
subalgebras of maximal dimension in simple Lie algebras, allowing us to adapt 
the previous argument to show the 

9.4. Proposition. The variety 21 of abelian algebras consists of infinitely many G-orbits 
if G has one of the following types: 

Ar {r > 5) Br (r > 4) C, (r > 5) D^ (r > 6) Ej Eg- 

Proof. Let r be the rank of our semi-simple group, n its number of roots, m 
the largest dimension an abelian unipotent subalgebra of g can have, and m an 
abelian unipotent subalgebra with this dimension. Let be an abelian subal- 
gebra of g contained in m. On the one hand, lies in the nilpotent cone of g, 
according to | |9.2| | the G-orbit through in 21 has dimension less than r — 2. On 
the other hand, the set of all possible is the Grassmann variety Q{r,m), which 
has dimension r{m — r). We conclude by an explicit computation that when- 
ever r{m — r) > r — 2, the action of G on 2t must have infinitely many orbits. D 

9.5. Theorem (Malcev). Each simple Lie algebra with the exclusion of B4, D4 and G2 
has up to automorphisms only one commutative subalgebra of maximal dimension with 
nilpotent elements. This dimension equals [|(r — l)^]/or the algebra Ar {r > 2) (brack- 
ets stand for the integer part of their argument), jr{r — 1) +\for Br [r > 4), jr{r + 1) 
for Cn, \r{r — 1) for D„, and 16, 29, 36, 9 and 5 respectively for Eg, E7, Eg, F4 and B3. 
The algebra B4 has two classes of conjugate abelian subalgebras of maximal dimension 7, 
D4 has two classes of dimension 6 and G2 has three classes of dimension 3. 

9.6. Non algebraic anisotropic algebras. While the irreducible component 91 
of 2t contains only algebraic subalgebras of g l|5.3t , this is not the case of 21. 
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9.7. Proposition. If a semi-simple group has rank large enough, its variety 21 ofabelian 
algebras contains non algebraic elements. 

Proof. Let G be a semi-simple group of rank r, and s a degenerate semi-simple 
element of its Lie algebra g. If r is large enough, the set of nilpotent elements 
in Q commuting with s contains a r-dimensional linear subspace: this is most 
easily seen when s is the coroot associated with an extremal node in the Dynkin 
diagram of G, in this case the centralizer of s has semi-simple part a simple group 
of rank r — 1 and one can readily use Malcev theorem | |9.5t . If the semi-simple part 
of the centralizer of s in G has multiple simple ideals, one has to apply Malcev 
theorem on each of them, to conclude. Let m he a basis of such a space, the Lie 
algebra spanned by s + m-[, m2, . ■ ■ , my, is non algebraic, since it is not closed 
under the Chevalley-Jordan decomposition. D 

Appendix A. Tempered moving frames above degeneracy curves 

IN Grassmann varieties 

We study moving frames along degeneracy curves in Grassmann varieties and 
prove the technical result l lA.81 . We use here the language of degeneracies intro- 
duced inliiil 

A.l. Notations. Let E be a vector space of finite dimension, A\ a r-dimensional 
subspace of £ and C° a smooth and irreducible curve in GL(E). We let Aq be a 
r-dimensional subspace lying in the closure of the curve C° A\ in the Grassmann 
variety Q(r, E) of r-dimensional subspaces of £. We denote by 7~(r, £) the tauto- 
logical bundle T{r,E) — )• Q{r,E). The principal bundle B{r,E) -^ Q{r,E) whose 
fiber at A is the set of all basis of A is a subbundle of the r-th bundle power 
of T(r, E). It maps onto the principal bundle J-'(r, E) — ^ Q{r, E) whose fiber at A 
is the set of complete flags of A. If x is a basis of A, we call its image in J-{r,E) 
the complete flag corresponding to x. Given a complete flag J- in A, we say that 
a basis x of A corresponds to J- when its image in J-{r, E) is J-. 

A.l. Tempered moving frames along degeneracy curves. Let Ai be a r-dimen- 
sional subspace of E and K an algebraic group acting linearly on E. We choose 
a point Aq lying in the closure of the orbit KAi of K in Q{r, E) containing Ai, a 
degeneracy curve C° in K and Cg a point at infinity taking Ai to Aq. If x is a basis 
of Ai, we obtain a moving frame along C°Ai by sending c to the point {cAi,cx) 
oiB{r,E) cg{r,E) xE\ 

This moving frame will usually not extend at cg. In the first place, it will not 
do because the vectors cx^ may become infinitely small or infinitely large. In the 
second place, the lines defined by two vectors ex, and ex,- may degenerate to a 
single line. If ex, is asymptotically smaller than ex,, no linear combination of ex, 
and ex, can yield a second direction at cq. 

The first difficulty is circumvented by replacing ex by the associated tempered 
moving frame: it is obtained from ex by rescaling its terms | |A.6| |. We are able to 
characterize the basis in Ai for which the second difficulty does not occur. They 
are the basis of Ai whose associated flag is a refinement of some partial flag in Ai 
determined by C° . We call this partial flag the magnitude orders flag, it is defined 
in IIA.4b. 
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From now on we denote by Rq the local ring of the smooth completion C of C° 
at Co, by mo its maximal ideal, by Lq its ring of fractions and by e e mo a local 
parameter of C at Cq. As the irreducible smooth curve C° uniquely determines its 
smooth completion C, we call Rq the local ring of C° at Cq and e a local parameter 

of C at Co. 

A. 3. Filtration by the magnitude order. We consider a linear representation V 
of K, for instance an exterior power of E. For any vector v E V, the rational 
map cv from C to V is an element of Lq V. Thus, the asymptotic behaviour 
of vectors in V under the operation of c near Cq is related to the structure of 
the Ko'i^odule Lq V. 

The Lg-vector space Lo ® V is a Rg'iriodule filtered by the submodules xtIq {Rq ® 
V) for k E Z. For any v E LqiSiV\{0} we call the number 



cv{v) = sup(k eZ mQiRQi^V) 3v\ 



the magnitude order of v near cq, or briefly the magnitude order of v. Note that the 
zero vector has no magnitude order. For any i^i, Z72 in Lo V \ { } we have 

co{vi +V2) > inm{aj{vi),oj{v2) }, 

unless z?! + 272 = 0. 

A.4. Magnitude orders flag and corresponding basis. We describe a filtration 
on Ai associated to the filtration of Lo E by the magnitude order, which yields 
a partial flag in Aj. In the theory of the module Lq (E> E over the principal ideal 
domain Rq, this flag is related to the invariant factors of the submodule Rq ® Ai 
of the finitely generated module Rq<SiE. 

To any integer k w^e associate the subspace {A-[)i^ of Ai defined by 

(Ai)fc = { X e Ai \ { } I cv{cx) > A: } U { } . 

Let (flj, . . .,flm) be the increasing sequence of integers k such that (Ai)j- is a strict 
superset of (Ai)jt+i. We thus have {Ai)a^ = Ai and {Ai)i^a„ = {0}/ ^rid it is 
convenient to put flm+i = 1 + o-m- This yields a partial flag 

{(Ai)«j D • • • D (Ai)„,„ } 

of Ai. 

A.5. Definition. The partial flag Ff = { {Ai)a^ D • • • D {Ai)a„ } of Ai is the 
magnitude orders flag. A magnitude orders basis of A^ is a basis x E A'^ oi A\ 
corresponding to a complete flag finer than the magnitude orders flag. 

The natural map B{r,E) -^ J-{r,E) is onto, which implies the existence of 
magnitude orders basis of Aj. 

A.6. Definition. Let x be basis of A^. The tempered moving frame associated 
to X is the map sending c G C" to (cAi,e^'^('^^i'cxi, . . .,e^'^('^^'''cx,-). 

A. 7. Extension of tempered moving frames. Our characterization of tempered 
moving frames that extend at infinity is the following 

A. 8. Theorem. Let x be a basis of Ai. The following conditions are equivalent: 
(1) X is a magnitude orders basis of Ai; 
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(2) the finite sequence (a;(cxi-))i<A:<r ^s non-decreasing and for any 1 < k < r we 
have 

k 
co{cx-[ A ■ ■ ■ AcX]^) = y^a;(cx;) 
1=1 

for magnitude orders in the RQ-module A'^(Lo (8> E). 

(3) f/ie tempered moving frame associated to x extends at Aq = cqAi, and its value 
at cq is a basis of Aq. 

We will only give a few indications about its proof, for it is rather lengthy and 
has little to do with the geometry of varieties of reductions. The hard work is 
the proof that (2) implies (3). This can be done by using a variation of Smith's 
algorithm computing the normal form of a matrix whose coefficients are in the 
principal ideal domain Rq. From this standpoint (2) means that the principal 
minors of the matrix whose columns are the coordinates of the tempered frame 
associated to x are invertible in Rq. 

We also state without proof the following technical result: 

A. 9. Proposition. Let A^ = B^ (B ■ ■ ■ ®B^ be a direct sum decomposition of A^. There 
exists a magnitude order basis of Ai whose terms are /n B^ U ■ ■ ■ U B'. 

Appendix B. Closures of decomposition classes 

We use the rigidity theorem 14.61 to show that the closure of a decomposition 
class is a union of decomposition class. It seems that this was yet only proved for 
the reductive symmetric pairs associated to the Cartesian square of a reductive 
group Wi 39.2.7]. 

B.l. Theorem. Let {G,6) be a reductive symmetric pair, and p its anisotropic space. 
For any x in p, the closure of the decomposition class 'D{x) of x in p is a union of 
decomposition classes. 

Proof. Let K = (G^)° be the connected component of the fixed point group of d. 
According to |1^, 39.5.2] we have: 

V{x) = K ■ {cl{xs)o+x„) = K ■ {cl{x)o) 

(see I I3.2I I for the definition of c^{xs)o and Cp(x)o). Let y be a point in the clo- 
sure r'(x) of T>{x) in p. We show that T>{y) is contained in V{x). Since this 
closure is X-stable, it is enough to prove that Cp (i/s) + J/n C X'(x). 

Let T° c K X Cp(x)o be a smooth curve such that y lies in the closure of the 
image of F" by the map sending {g,z) to gz. For all {g,z) in F" we have Cp(gz) = 
gCp{x) so that the projection C° of F" in K pushes the anisotropic algebra Cp(x) 
toward an anisotropic algebra containing y. A double centralizer is closed un- 
der Chevalley-Jordan decomposition, hence w^e can assume by the rigidity theo- 
rem |4[6] that i/s belongs to Cp(x) and C° is a subset of the centralizer of i/s in K. 
But then Cp (i/s) C Cp (xg) C Cp (x) so we are done. D 
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